Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add clip finder submodule #7

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

fguzman82
Copy link

CLIP-Finder v1.3

CLIP-Finder enables semantic offline searches of images from gallery photos using natural language descriptions or the camera, with predictions around 1ms using the Neural Engine.

Changes

  • Added the CLIP-Finder submodule in the CLIP-Finder directory.
  • Added CLIP-Finder description to the README.md.

Motivation and Context

Inspired by the examples in coreml-examples, I would like to include this project. Adding this submodule will enhance the repository with advanced image and text similarity search capabilities based on MobileCLIP. (According to the authors, CLIP Image is based on FastViT), leveraging CoreML and on-device processing for efficient and private operations.

🚀 Performance Enhancements

  • 🏎️ Batch Processing: Implementation of batch processing to optimize the preprocessing stage during the first launch of the app. This significantly reduces the time required to index the photo library.
  • 🔄 Sync Button was added, enabling synchronization with the Photo Gallery without restarting the app. It updates with new photos and removes deleted ones from the records.

Checklist

  • I have tested these changes locally.
  • I have updated the documentation as needed.
  • Release available on TestFlight.

@fguzman82 fguzman82 marked this pull request as draft August 12, 2024 11:01
@fguzman82 fguzman82 marked this pull request as ready for review August 12, 2024 11:02
@fguzman82
Copy link
Author

🤗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant